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The assuiptions behind secondary school literature 
course tests-^uhet her asking students to recall aspects of literary 
works, to relate literary works to each other, or to analyze 
unfaalllar literary works— are open to question. They fail to 
acknowledge soae of the aost laportant aspects of literature which, 
if properly taught, should provide a broad experience of doiestic and 
foreign cultures, create a literate populace, develop student 
coaprehenslon of and response to events, and cultivate an articulate 
and infer led taste. Hith several specific behavioral objectives as 
testing guides, both objective and essay tests aay be 
foraulated— deftly and carefully— which would include questions 
cpncerning coaprhenslon, perception of literary foris, eaotional 
response and its articulation, aesthetic judgient, and the value to 
the student of literary experiences. (JH) 
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TESTING? TESTING? IN LITERATURE? ^ ^^^^o:^^'^^:^; 
Alan C. Purves owner 
Yes, yes, yes, and no, no, no, and might be, might be, mlgl^t be'are the 

three sets of answers I have to the questions In the , title of this talk. 

Yes, testing goes on. Yes testing In literature goes on. That Is to say, 
teachers who teach literature courses often give tests. More often than not, 
those tests ask students to recai r aspects of books, stories, poems, pUys they 
have read. Or they ask students to place the works they have read Into some 
inrgor context -thematic, most probably, although sometimes histrorlcal or 
sometimes aesthetic.- Many literature courses ha vei- tests with questions like: 
"Napoleon and Snowball are rivals in what book?" or like "How do J. D. Salinger 
and Ann Petry treat the theme of "the search for identity?" Some teachers will 
vary th e a.a rm a b - oe Memory test ing by using the critical reading test device of 
giving the students an unfamiliar text and asking th^m questions about that 
text— often asking for an analysis and interpretation of it. 

I chink that I have described what typifies most testing of students in 
secondary school literature courses. Students are asked to recall aspects of 
literary works; they are asked to relate literary works to each other, and they 
are asked to analyze unfamiliar literary works. Sometimes they are asked t,v 
[)er|grm these acts in timed tests, sometimes in take-home essays, sometimes in 
other media like film or some oral or dramatic form. 

Sometimes teachers use externally prepared tests, like the Iowa tests or 
the Hoskins-Sanders tests. These tests ask many of the same sorts of questions 
although often In a multiple-choice format. 

On the basis of these externally or internally made tests students are 
sotted ^nd rated as to their literary ability or achievement. That is what is 
going on, I think. At least that is what I have observed^- 
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What are the assumptions behind this kind of testing? The first would seem 
to be that literary works--or certain parts of them should form part -of . the 

♦ 

memory core of human beings. The second is that the students should be able to ' 
connect works of literature with -each other according to a certain set of 
linkages-often the linkages of a unit or an elective course title. The third 
is that students shouldlearn the operations of a professional critic or someone's' ' 
perception of a professional critic. 

Ate these assumptions open to question? I think they are. I think it is 

questionable whether.many of the things we ask students to remember are worth 

remember ing.^Who is Holden is perhaps worth asking; who is Horwitz in the same 

book is not quite as important I suspect, but asking that question is the one • 1/ 

OS rt»y Son retnank^X of K\s +<2adW*r. 'Tf «he \X?'an^rs +0 kfxdW i-h* 
that s really going to trap them.^The function of literature in the memory is ! AliSW^h 



not direct, it forms a part of the exper lent ial worltf we have in our heads and\ <h'4 >taM 



we bring it forth in associative fashion more often than not. V ^ t^*" ^'f^^ 

I have a friend who when observing the 1972 campaign suddenly saw • 
that George McGovern was like Jay Gats by and our president very much 1 ike 

Nick Carraway. That is what Harry^Broudy has called the associative use of 
learning, and it Is probably the most important function of literature. 

^ questionable that we should expect students to p^it J: -jlE 

^i-torory works into the pigeonholes that we have created. Why should Catcher 
In Che Rye be classified as a search for identity book? WoU why not? But 
it could also be classified a fifties book, a city book, a book about man's 
inhumanity to man, a book about families, a book about love, a book about growing *" 
up, a book about existentialism, a confessional book, an American book. Kach 
of these and othets could be the title for a unit Into which Catcher could be 
placed. The linkages between selections are arbitrary as are the cUsalftcatlons 

ERIC 



placed upon any single book. It might be as important for students to see 
what their pigeonholes are as it is to see if they can put things in *ours. 

As to the assumptions underlying analytical questions, the major 
assumption I have foun6 is that the tester wants the student to ape the kind 
of criticism that the tester was trained in, I have recently completed a 
study of literature education in ten countries One of the major findings of 
that study is that by the end of secondary school, most students in a country 
acauire a pattern of critical response to literary works characteristic of 
that country. We asked students and. teachers to list the questions they thought 
most important to ask after reading a piece of fiction, , At age fourteen, the 
students were interested in a wide variety of questions; by the end pf secondary 
school they were interested in fewer. And wonder of wonders, they ch6ose the 
questions that were preferred by the teachers. That 'finding bothers me. It 
-bothers me in that I see the real criterion of achievement in literature being 
whether the students can agree with their teachers. It seems to me that 
that is what too many of the tests in literature are about, what too many of the 
judgments of achievement are. 

Those then, are my no's, I think that the dangers of literature teaching 
ond testing lie in the fact that they fail to acknowledge some of ' the most 
important aspects of literature and 1 iterature study, Tiie first Is that literature 
exists as a source of pleasure as well as a source of lnstruction--it instructs > 
through pleasure. The second Is that a single work of literature is incapable 
of being caught by any single criticism of It. It may not even be caught by a 
multlperspectived criticism. The third Is that the experience of literature 
contains unique and common elements, unique to the individual reader and common 
to a class of readers. 



This being so, I would say that teachers might be held accountable for 
certain aspects of literature education. ' ' 

1, Teachers should, I think, be accouatable to the public for, providing 

a vide variety of literary selections to students. The reasons for this 
lie less in research than in conventional wisdom^ He are a pluralistic 
society in a polycultural world, and students should experience as 
broad a variety of those cultures both foreign and domestic. I say 
experience advisedly, for I think that the measurement of broad 
experience can only be indirect. The fruits 06 broad reading occut 
as Harry Broudy says not as directly replicated in memory tests but as 1 
they ar6 used in Interpreting other experiences and the predictability 
of that use is .quite uncertain. • ' ' •* 

2. Teachers should be held accountable for fostc^ring an interest In , 
literature and the variety of satisfaction people can gain this firom. 
This objective I see negatively in that literature, reading, televisi^ 
watching, films, theatre, and the like are often enjoyed by marty children 
in the early years of school and often tliey lose interest as. they 
progress through school . This is true particularly in th^ United States 
Kl.li.A>4^ ^nd the cause may be laid in part to the afct Ions of teachers 
and classes. This Is a fundamental anomaly in the fact that wo take 

a pleasurable leisure activity and mak^ it work. We should, I think, 
make It play--serious play, Intellectual play, but play. There are 
ways of doing it, I think. The reasons for doing It hnve to do with the 
creation of a literate articulate populace, for perpetuating the very 
plura>lflm that we cherish, and we should try to prevent literature from 
becoming the property of our elite. 
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3. Teachers should be held accountable for the development of abilities 
of students to comprehend and, more importantly, to be aware of how 
language and literature can manipulate their .responses to, events. 

News media, advertising, political speakers, poets all seek to manipulate 
people^s responses to events* They do so thrpugh their control of 
language, through their manipul&ticti of » the shaping and structuring of * 
events- -what they put next to what, what they omit, and the like* A 
literate p^ibtic should, I think, be aware of how literature and other 
VXHTb'dl forms of expression operate to affect their thoughts and f^el Ings, 

4. I think teachers should be accountable for the development of an 
articulate and lnforma4r taste. I don^t think teachers should or could 

influence the .preferences of readers^ but they can "certainly 'raise With 

■.. ... 1 ■ . 

their students questions of why they prefer what they do, questions of 
what might account for differences. '* 
Can we build a set of tests or some principles of testing on these principles? 

Heref is where the might he's enter. Before we make up tests, we must make up 

♦ 

test specificatloris, and these call for--yes, you guessed lt--behavioral object ives 
Let us try a couple of objectives on for size. Jhe student Is able to describe 
- .^^^^^^^^^^^^^^ is way the nature of the pleasure he derived from exper ienc Ing a p ieco of 

literature so that an observer is able to comprehend the nature of that pleasure. 
The student Is able to communicate In his way the kind and degree of Instruction 
he derived from a piece of literature so that an observer is able to comprehend 
the nature and extent of that Instruction* The student is able to communicate 
his experience of a piece of literature in such a way that others may remark the 
ways in which that experience Is unique or shared by others. These first three 
objectives deal primarily with the student's rhetorical abllttyi Thcte is a 
fourth objective that derives from the fact that literatute is an fitrt form; 
J This $tude^^^ is able to describe the ways by which the formal as well as the 
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experiential aspects of a piece of literature have operated to create the literary 
experience that that student has had in such a way that an observer can assent 
to the existepce of those formal experiential aspects in the work and the possibility 
of their creating the experience described* This objective carries with it the 
rhetorical ability and some concepts about literature as an art form. 

All of the objectives speak to the fact thatt the study jf literature in 
schools assumes the importance of articulating one's experience . That articulation 
need not be writ^:en or verbal, but it must be comnunicated. It rust speak where 
all the arts are dumb^ as many critics have said. -The objectives dd not in&ist 
on the articulation meeting the criterion of matching the critical pronouncement 
of an adult, much less a professional/ I have found In other studies^that 

younger students tend tp perceive literary works in terms of "details and specifics 

■ ■ . ■ ^ \ 

rather than in terms of generalizations* Given a cata^logue of symptoms about a 
sick character in a story, students tend not to generalize that the character 
is sick until they reach the age of fifteen or sixteen. At the upper reaches 
of secondary school they may be ready to go beyond such generalizations to symbolic 
readings. Why should we expect a group of adolescents to perceive an adolescent 
character from the vantage point of a middle-aged Ph.D. or even a college 
graduate who has been the student of that culddle-aged Ph^D? 

What iorts of tests might we derive from these objectives? Fits: cf all 
they would be tests that require the student to perceive a literary selection, 
respond to it, and express a response. As far as perception is concerned, the 
tests might ask how the Student perceives certain aesthetic or literary concepts 
operating in the selection: what voice or voices did the student observe, what 
did the student perceive as the shape or structure of the selection, what 
linguistic transformations of experience did the student observe. Are there 
right answers to these questions? In a general sense there are* In Catcher tn 
th$ Rye there is a narrator Holdenj is Holden equivalent to J, D, Salinger? 

erIc . 
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What other voices and poinis of view appear? I think consensus would suggest 
that Holden is the main voice and main point of view; others are seen through 
his eyes, which may or may not be those of J. D. Salinger. The structure is 
roughly chrouologf cal but told in retrospect, and it is episodic. The language 
Is 1940 's teen-age. This set of perceptions is relatively routine, the kind 
of summary statements that one could ask in a test of reading comprehension. 

But the perception of the thing is not simply descript Ive. How is the 
itory perceived emotionally? For this kind of testing, one eminent scholar- 
teacher has used a series of scales,^ The student, .would be asked rate. , 
Holden, say on a scale of one to five oii such dimensions as sincerity, power, 
honesty, malevolence, toughness, changeableness , and Vhe like. From this series 
of scales, which might be repeated at different times in the reading, v the tester 
can get a sen*t^ of the student's emotional perception of the characters. Beyond 
th'it, the teacher might ask the student to talk or write about these emotions. 
Does the description fit the scales? Do the scales become fully articulated and 
communicated? Is the complexity of emotion recorded by the scales captured 
in the verbal description? The teacher would not expect it to be at first, but 
the students' growth might well be in terms of these criteria? The same kinds 
of scales might be used with the whole selection^ although the terms might 
become more aesthetic ones, or ones more adaptable to the selection. 

The next question Is what do the students get out of the selection? 
Again a set of probing questions might be appropriate in that they might set 
the students to exploring their responses more fully than a simple "what did you 
get out of it?" One way is to pose a list of alternative areas of consideration. 
Do you think the story is more about human relationships, about society, about 
what goes on in a petson, about the way we are, about the way we should be. 
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about yoursc li ? These invicat ions are co be se lected amcnfo and then expanded. Anothef 
«:est situation would be to pose the students the problem of filming or staging 
the selection. What would be the selection'^ mood? How would chacactors be 
cast? How would the setting be done, how wr.u Id the, action go? The students 
are asked to confront all thu issues they rlfght ccver in a paper or examination, 
but their testing could be on the coherence with which they justify their 
decisions and put them all together. The evidence would be that they were 
thinking about what they were doing. • 

Th>jse testing devices call- for a. variety of means.. They call for sortie' 
objective and even multiple -choice items. Certainly the lesser aspects of 
perception can be so measured, but' those scores must be coordinated with 
judgments of the articulation of the subtler aspects of response, of the 
perception and translation into some externalized medium of that perception. 
The criterion for Judglns that statement is not whether the students perceptions 
are those of the teachers, but whether th^y conform to some of the rules of 
discourse. Are they clear? Are they coherent? Are they Interesting? These 
Judgments can be made individually by the teacher or collectively by a jury of 
other students. 

There is one other aspect of testing In literature which should not be ' 
neglected. That Is a test of whether literature and the literary experience 
is valued by the btudents. To so test Is not to Judge the students, but to 
judge Liic effectiveness of Instruction. There Is no reason for students not 
to value literature, not to be Interested in It save for the success of schools 
In killing off that Interest. If students emerge from a course or a curriculum 
liking reading, with fewer interests In books, films, theatre, television than 
IfeJ?:!- entered with, then something drastic ought to be done about that 
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curriculum or course. In interview. „Uh hl,h school seniors who don't Uke 
literature, I »„, .Hey can often plaint their dislike to a si;,gre class 
or a single teacher. «ore often than not that teache, „as one „ho, forced the„ 
into a particular critical mold before they „ere ready for It. 

Testing ,n uteratura might, then. Include ,ues'tIons of comprehension 
.uestlons of perception of oertal. literary forms, questions of emotional ' 
.-.^ponse and Its articulation, questions o, what the students got ,r^ the 
Hterature read, questions o, aesthetic Judgment, and questions of value about 
the literary experience. To give a c^prehanslve account of what ohe has- done 
one Should Include all these matters as well as matters concerning the amount 
of reading and literary activity tV students have done and will do... All of 
this can be done without violating the series of expertences the students hav. 
had with literary works, without destroying the tentatlveness and Individuality 
Of literary experience. It can be done deftly, it can be done very carefully. 
It one is going to hold oneself accountable tor those aspects of literary 
instruction that I mentioned earlier. It must be done very carefully. One 
shou.dn.t try to trap the students, one should use tests to find out how far 
thay have come 1^ understanding themselves and how Imaginative language work, 
on their imaginations. _ 



